Broad Learning System Based on Maximum Correntropy Criterion
نویسندگان
چکیده
As an effective and efficient discriminative learning method, broad system (BLS) has received increasing attention due to its outstanding performance in various regression classification problems. However, the standard BLS is derived under minimum mean square error (MMSE) criterion, which is, of course, not always a good choice sensitivity outliers. To enhance robustness BLS, we propose this work adopt maximum correntropy criterion (MCC) train output weights, obtaining correntropy-based (C-BLS). Due inherent superiorities MCC, proposed C-BLS expected achieve excellent outliers while maintaining original Gaussian or noise-free environment. In addition, three alternative incremental algorithms, from weighted regularized least-squares solution rather than pseudoinverse formula, for are developed. With can be updated quickly without entire retraining process beginning when some new samples arrive network deems expanded. Experiments on data sets reported demonstrate desirable methods.
منابع مشابه
Learning with the maximum correntropy criterion induced losses for regression
Within the statistical learning framework, this paper studies the regression model associated with the correntropy induced losses. The correntropy, as a similarity measure, has been frequently employed in signal processing and pattern recognition. Motivated by its empirical successes, this paper aims at presenting some theoretical understanding towards the maximum correntropy criterion in regre...
متن کاملMulti-label Active Learning Based on Maximum Correntropy Criterion: Towards Robust and Discriminative Labeling
Multi-label learning is a challenge problem in computer vision fields. Since annotating a multilabel instance costs greatly, multi-label classification has become a hot topic research. State-of-theart active learning methods either annotate all the relevant samples without diagnosing discriminative information in the labels or annotate only limited discriminative samples manually, that has weak...
متن کاملRobust diffusion maximum correntropy criterion algorithm for distributed network estimation
Robust diffusion algorithms based on the maximum correntropy criterion(MCC) are developed to address the distributed networks estimation issue in impulsive(long-tailed) noise environments. The cost functions used in distributed network estimation are in general based on the mean square error (MSE) criterion, which is optimal only when the measurement noise is Gaussian. In non-Gaussian situation...
متن کاملRobust and stable gene selection via Maximum-Minimum Correntropy Criterion.
One of the central challenges in cancer research is identifying significant genes among thousands of others on a microarray. Since preventing outbreak and progression of cancer is the ultimate goal in bioinformatics and computational biology, detection of genes that are most involved is vital and crucial. In this article, we propose a Maximum-Minimum Correntropy Criterion (MMCC) approach for se...
متن کاملRobust Hammerstein Adaptive Filtering under Maximum Correntropy Criterion
The maximum correntropy criterion (MCC) has recently been successfully applied to adaptive filtering. Adaptive algorithms under MCC show strong robustness against large outliers. In this work, we apply the MCC criterion to develop a robust Hammerstein adaptive filter. Compared with the traditional Hammerstein adaptive filters, which are usually derived based on the well-known mean square error ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE transactions on neural networks and learning systems
سال: 2021
ISSN: ['2162-237X', '2162-2388']
DOI: https://doi.org/10.1109/tnnls.2020.3009417